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Abstract — The common approach to radial distortion is by 
the means of polynomial approximation, which introduces 
distortion-specific parameters into the camera model and re- 
quires estimation of these distortion parameters. The task 
of estimating radial distortion is to find a radial distortion 
model that allows easy undistortion as well as satisfactory 
accuracy. This paper presents a new piecewise radial distor- 
tion model with easy analytical undistortion formula. The 
motivation for seeking a piecewise radial distortion model is 
that, when a camera is resulted in a low quality during man- 
ufacturing, the nonlinear radial distortion can be complex. 
Using low order polynomials to approximate the radial dis- 
tortion might not be precise enough. On the other hand, 
higher order polynomials suffer from the inverse problem. 
With the new piecewise radial distortion function, more flex- 
ibility is obtained and the radial undistortion can be per- 
formed analytically. Experimental results are presented to 
show that with this new piecewise radial distortion model, 
better performance is achieved than that using the single 
function. Furthermore, a comparable performance with the 
conventional polynomial model using 2 coefficients can also 
be accomplished. 

Key Words: Camera calibration. Radial distortion. Radial 
undistortion, Piecewise Function. 



I. Introduction 

Cameras are widely used in many engineering automa- 
tion processes from visual monitoring, visual metrology to 
real time visual servoing or visual following. We will focus 
on a new camera distortion model which uses a piecewise 
radial distortion function yet having an analytical undis- 
tortion formula, i.e., no numerical iteration is required for 
undistortion. 

A. Camera Calibration 

Camera calibration is to estimate a set of parameters 
that describes the camera's imaging process. With this set 
of parameters, a perspective projection matrix can directly 
link a point in the 3-D world reference frame to its projec- 
tion (undistorted) on the image plane by: 
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where (m, v) is the distortion-free image point on the image 
plane; the matrix A fully depends on the camera's 5 intrin- 
sic parameters {a, 7, /3, uq, vq) with (a, /?) being two scalars 
in the two image axes, [uq, vq) the coordinates of the princi- 
pal point, and 7 describing the skewness of the two image 
axes; [X'^jY'^, Z'^]'^ denotes a point in the camera frame 
which is related to the corresponding point [X"^ , , Z'^]'^ 
in the world reference frame by P'^ = RP"" + 1 with (R, t) 
being the rotation matrix and the translation vector. For 
a variety of computer vision applications where camera is 
used as a sensor in the system, the camera is always as- 
sumed fully calibrated beforehand. 

The early works on precise camera calibration, start- 
ing in the photogrammetry community, use a 3-D calibra- 
tion object whose geometry in the 3-D space is required 
to be known with a very good precision. However, since 
these approaches require an expensive calibration appara- 
tus, camera calibration is prevented from being carried out 
broadly. Aiming at the general public, the camera cali- 
bration method proposed in focuses on desktop vision 
system and uses 2-D metric information. The key feature 
of the calibration method in is that it only requires the 
camera to observe a planar pattern at a few (at least 3, if 
both the intrinsic and the extrinsic parameters are to be 
estimated uniquely) different orientations without knowing 
the motion of the camera or the calibration object. Due to 
the above flexibility, the calibration method in [T] is used in 
this work where the detailed procedures are summarized as: 
1) estimation of intrinsic parameters, 2) estimation of ex- 
trinsic parameters, 3) estimation of distortion coefficients, 
and 4) nonlinear optimization. 

B. Radial Distortion 

In equation (u, v) is not the actually observed image 
point since virtually all imaging devices introduce certain 
amount of nonlinear distortions. Among the nonlinear dis- 
tortions, radial distortion, which is performed along the 
radial direction from the center of distortion, is the most 
severe part H], O- The radial distortion causes an inward 
or outward displacement of a given image point from its 
ideal location. The negative radial displacement of the im- 
age points is referred to as the barrel distortion, while the 
positive radial displacement is referred to as the pincush- 
ion distortion The removal or alleviation of the radial 
distortion is commonly performed by first applying a para- 
metric radial distortion model, estimating the distortion 
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coefficients, and then correcting the distortion. 

Lens distortion is very important for accurate 3-D mea- 
surement Let {ud,Vd) be the actually observed image 
point and assume that the center of distortion is at the 
principal point. The relationship between the undistorted 
and the distorted radial distances is given by 

rd = r + Sr, (2) 

where is the distorted radial distance and Sr the radial 
distortion (some other variables used throughout this paper 
are listed in Table P). 



TABLE I 
List of Variables 



Variable 


Description 


{Ud, Vd) 


Distorted image point in pixel 


{u, v) 


Distortion-free image point in pixel 


{xd, yd) 


[xd, yd, '^V = ^~^[ud, vd, 1]^ 


{x, y) 


[x, y, \Y^A-\u, V, If 


Td 


ri = xl + yj 


r 




k 


Radial distortion coefficients 



Most of the existing works on the radial distortion mod- 
els can be traced back to an early study in photogrammetry 
where the radial distortion is governed by the following 
polynomial equation pQ, [5], [7], [S]: 

rd = r fir) = r (1 + k^r^ + fear'' + /cgr^ + ■••), (3) 

where fci, A:2, fcs, • • • are the distortion coefficients. It follows 
that 

Xd = xf{r), yd = yf{r), (4) 
which is equivalent to 

( Ud- uq = (u - uq) f{r) 
\ Vd-vo^ (v- vo) fir) 

This is because 

Ud = axd + JVd + uo, 

= axf{r) +jyf{r) +uo 
= {u- uq) f{r) + uq 

Vd = Pyd + VQ. 

= {v - Vo) f{r) + Vo 

For the polynomial radial distortion model (|3Jl and its 
variations, the distortion is especially dominated by the 
first term and it has also been found that too high an order 
may cause numerical instability [3], |^. When using 
two coefficients, the relationship between the distorted and 
the undistorted radial distances becomes ^ 

rd = r{l + kir^ + k2r^). (6) 



The inverse of the polynomial function in @ is difficult to 
perform analytically but can be obtained numerically via 
an iterative scheme. In IQ. , for practical purpose, only one 
distortion coefficient ki is used. 

To overcome the inversion problem, another polynomial 
radial distortion model using also two terms is presented 
m HU with 

f{r) = l + kir + k2r^, (7) 

whose appealing feature lies in its satisfactory accuracy 
as well as the existence of an easy analytical undistortion 
formula. The polynomial radial distortion model in (|7|l- 
together with the commonly used model ©, acts as the 
benchmark for evaluating the performance of the piecewise 
radial distortion model proposed in Sec. IIIII 

In this work, a new piecewise radial distortion model is 
proposed, which allows analytical radial undistortion along 
with preserving high calibration accuracy. To compare the 
performance of different distortion models, final value of 
optimization function J, which is de&ied to be 

N n 

J = ^^||to„- -m(A,k,R„t„M,)f , (8) 

i=l 3 = 1 

is used, where m(A, k, R.^, t^, Mj) is the projection of point 
Mj in the i*'* image using the estimated parameters; k de- 
notes the distortion coefficients; Mj is the j*'' 3-D point 
in the world frame with =0; n is the number of fea- 
ture points in the coplanar calibration object; and N is the 
number of images taken for calibration. In the estima- 
tion of radial distortion is done after having estimated the 
intrinsic and the extrinsic parameters and just before the 
nonlinear optimization step. So, for different radial dis- 
tortion models, we can reuse the estimated intrinsic and 
extrinsic parameters. 

The rest of the paper is organized as follows. Sec. 
describes the polynomial radial distortion model IJJ) with 
its analytical undistortion function. In Sec. IIIII the new 
piecewise radial distortion model is proposed. Comparisons 
with models © and Q are presented in Sec. lIVI in detail. 
Some concluding remarks are given in Sec. Finally, a 
dedicated section. Sec. I VII is prepared for practitioners on 
how this work can be useful in practice. 

II. Radial Distortion Model Q 

A. Model 

The conventional radial distortion model JH)) with 2 pa- 
rameters does not have an exact inverse, though there are 
ways to approximate it without iterations, such as the 
model described in J^li where r can be calculated from 
rd by 

r^rd{l-kirl-k2r^a). (9) 

The fitting results given by the above model can be sat- 
isfactory when the distortion coefficients are small values. 
However, equation introduces another source of error 
that will inevitably degrade the calibration accuracy. Due 



3 



to this reason, an analytical inverse function that has the 
advantage of giving the exact undistortion solution is one 
of the main focus of this work. 

To overcome the shortcoming of no analytical inverse for- 
mula but still preserving a comparable accuracy, the radial 
distortion model (O has the following three properties: 

1) This function is radially symmetric around the center 
of distortion (which is assumed to be at the principal point 
{uo,vo) for our discussion) and it is expressible in terms of 
radius r only; 

2) This function is continuous, hence = iff r = 0; 

3) The resultant approximation of Xd is an odd function 
of X, as can be seen next. 

Introducing a quadratic term fci in |(7J , this distortion 
model still approximates the radial distortion, since the 
distortion is in the radial sense. 
From O, we have 



f(r) 



Xd 

yd -■ 



- xf{r) 

yf{r) 



: a; (1 + kir + fc2r^) 
y{l + kir + k2r^) 



(10) 



It is obvious that = iff cc = 0. When Xd ^ 0, by letting 
c — Vd/xd — y/x, we have y = cx where c is a constant. 
Substituting y — cx into the above equation gives 



Xd 



1 + fci v^E^ + c^a? + fc2(x^ + c' 



1 + /ciVl + c^ sgn(x)a; + fc2(l + c^)x'^ 



= x + fci Vl + c? sgn(a;) + ^2(1 + c^) a;^ (11) 

where sgn(a;) gives the sign of x and Xd is an odd function 
of X. 

The well-known radial distortion model that de- 
scribes the laws governing the radial distortion does not 
involve a quadratic term. Thus, it might be unexpected to 
add one. However, when interpreting from the relationship 
between (x^, yd) and (x, y) in the camera frame as in equa- 
tion the radial distortion function is to approximate 
the Xd ^ X relationship which is intuitively an odd func- 
tion. Adding a quadratic term to 5r does not alter this fact. 
Furthermore, introducing quadratic terms to 5r broadens 
the choice of radial distortion functions. 

Remark II. 1: The radial distortion models discussed in 
this paper belong to the category of Undistortcd-Distorted 
model, while the Distorted-Undistorted model also exists 
in the literature to correct the distortion ^Sl- The radial 
distortion models can be applied to the D-U formulation 
simply by defining 

r = rdf{rd)- 

Consistent results and improvement can be achieved in the 
above D-U formulation. 

B. Radial Undistortion of Model ^ 
From 121, we have 

r^ + ar"^ + br + c = 0, 







Fig. 1 

A SMOOTH PIECEWISE FUNCTION (tWO-SEGMENT) 



with a = ki/k^, h = 1/^2, and c 
the above equation becomes 



'^'^dlk^- Let r = r — a/Z, 



where p 



aV3, q 



pr + q = 0, 

= 2a'V27 - ab/3 + c. Let A 



(|)2 + (|)3. If A > 0, there is only one solution; if A = 0, 
then r — , which occurs when Sr — 0; if A < 0, then 
there are three solutions. In general, the middle one is 
what we need, since the first root is at a negative radius 
and the third lies beyond the positive turning point fT5, 
T5^. After r is determined, {u,v) can be calculated from 
(O uniquely. 

III. PiECEWiSE Radial Distortion Model 

A two-segment radial distortion function is proposed and 
illustrated in Fig. ^ where each segment is a function of 
the form 



/i(r) = ao + air + a2 r^, for r e [0, ri] 
f2{r)^bo + bir + b2r'^, forrG(ri,r2] 



(12) 



with ri = r2/2. We arc interested in estimating the coef- 
ficients (00,01,02) and (607^17^2) such that the two poly- 
nomials are continuous and smooth at the interior knot 
r — ri. The reason for choosing a distortion function in 
O for each segment is that the radial undistortion can 
be performed using the analytical procedures described in 
Sec. Ill- B1 with no iterations. 

To ensure that the overall function 1)12(1 is continuous and 
smooth across the interior knot, the following 6 constraints 
can be applied 



(13) 



where /i = /i(ri) = /2(ri), /2 = /2(?'2), and di = /i(ri) = 
f2{fi). By enforcing that the two segments have the same 
value and derivative at the interior knot ri, the resultant 
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= /i 
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- 262 ri 
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+ b2 rl 


= h 
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flo 


= 1 




fll 


= (-2 


-ridi +2/i)/ri 




= (1 + 
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- fi + ridi - r2di) / (ri - r2)^ 


bi 




2b2n 


bo 




diri + h2r\ 



single function is guaranteed to be continuous and smooth 
over the whole range [0,r2]. Since each interior knot pro- 
vides 4 constraints to make the resultant single function 
smooth, in order to estimate the coefficients (ap, ai, 02) and 
(6oj ^ij ^2) uniquely, we need another two constraints, which 
are chosen to be /i(0) and /2(?'2) in Ijl^fl . 

Since the coefficients (00,01,02) and (&0)&i,^2) in (fO|l 
can be calculated uniquely from (/i, di, /2) by 



(14) 



the radial distortion coefficients that are used in the nonlin- 
ear optimization for the piecewise radial distortion model 
can be chosen to be (/i,c?i,/2) with the initial values 
(1, 0, 1), which has only one extra coefficient compared with 
the single model (|7|). During the nonlinear optimization 
process, the coefficients (09,01,02) and (601^11^2) are cal- 
culated from 1)14(1 in each iteration. 

The purpose of this work is to show that the proposed 
piecewise radial distortion model achieves the following 
properties: 

1) Given and the distortion coefficients, the solution of 
r from has closed-form solution; 

2) It approximates the commonly used distortion model 
© with higher accuracy than the single function (0 based 
on the final value of J in 

IV. Experimental Results and Discussions 

For the two-segment piecewise distortion model (|12|) . 
comparisons are made with the single model Q and the 
commonly used model ^ based on the final value of the ob- 
jective function J in JSJ after nonlinear optimization by the 
Matlab function f minunc, since common approach to cam- 
era calibration is to perform a full-scale nonlinear optimiza- 
tion for all parameters. Using the public domain testing 
images P^, the desktop camera images ^Tj (a color cam- 
era in our CSOIS), and the GDIS camera images ^J], ^Hl 
(the camera on GDIS robot built in our CSOIS), the final 
values of J, the estimated distortion coefficients, and the 5 
estimated intrinsic parameters (a, (3, 7, uqj ^^o), are summa- 
rized in Table im where the listed distortion coefficients are 
(fci, ^2) for the single models lO, and (/i, di, /2) for the 
piecewise. The extracted corners for the model plane of the 
desktop and the GDIS cameras are shown in Figs. |21 and |2| 
As noticed from these images, the two cameras both expe- 
rience a barrel distortion. The plotted dots in the center of 
each square are only used for judging the correspondence 
with the world reference points. 

From Table ^1 it is observed that the values of J us- 
ing the piecewise model for the three groups of testing im- 
ages are always less than those using the single function 
(IZJ. Furthermore, the fitting residuals are closer to those 
of model For the GDIS images, the value of J of the 



piecewise model is even smaller than that of model 
Thus, it is concluded that improvement has been achieved 
using the proposed piecewise radial distortion model. The 
comparison between model (fT^ with models , might 
not be fair since the new model has one more coefficient. 
However, our main point is to emphasize that by apply- 
ing the piecewise idea, higher accuracy can be achieved 
without sacrificing the property of having analytical undis- 
tortion function. 

Remark IV. 1: Classical criteria that are used in the com- 
puter vision to assess the accuracy of calibration includes 
the radial distortion as one part inherently 4^. However, 
to our best knowledge, there is not a systematically quan- 
titative and universally accepted criterion in the literature 
for performance comparisons among different radial distor- 
tion models. Due to this lack of criterion, in our work, the 
comparison is based on, but not restricted to, the fitting 
residual of the full-scale nonlinear optimization in JHJ. 

The resultant estimated f{r) curves for the three groups 
of testing images using the piecewise model (|12ll are plot- 
ted in Figs.^lSl andEI respectively, where the f{r) curves 
using the single function (0) are also plotted for compari- 
son. It is observed that the three piecewise /(r) curves are 
all slightly above the single /(r) curves. Unfortunately, so 
far, it is not clear to us whether or not it happens to be 
this case. 

Public Images 




Single - 



Fig. 4 

/(r) CURVES FOR THE PUBLIC IMAGES. 



Gne issue in the implementation of the nonlinear opti- 
mization is how to decide r2, which is related to the es- 
timated extrinsic parameters that are changing from iter- 
ation to iteration during the nonlinear optimization pro- 
cess. In our implementation, for each camera, 5 images 
are taken. r2 is chosen to be the maximum r of all the 
extracted feature points on the 5 images for each iteration. 

Remark IV. 2: To make the results in this paper re- 
producible by other researchers for further investigation, 
we present the options we use for the nonlinear op- 
timization: options = optimsetC 'Display' , 'iter', 
'LargeScale' , 'off, 'MaxFunEvals ' , 8000, 'TolX', 
10"^, 'TolFun', 10"^, 'Maxlter', 120). The raw 
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Fig. 2 

Five images of the model plane with the extracted corners (indicated by cross) for the desktop camera. 
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Fig. 3 

Five images of the model plane with the extracted corners (indicated by cross) for the ODIS camera. 



TABLE II 

Comparison of Radial Distortion Models Using Three Groups of Testing Images 



Images 


Model 


J 


Distortion Coefs 


Intrinsic Parameters (a, 7, uo, /?, wo) 


Public 


m 


144.8802 


-0.2286 0.1905 


832.4860 0.2042 303.9605 832.5157 206.5811 


m 


145.6592 


-0.0215 -0.1566 


833.6508 0.2075 303.9847 833.6866 206.5553 


m 


144.8874 


0.9908 -0.0936 0.9653 


831.7068 0.2047 303.9738 831.7362 206.5670 


Desktop 


© 


778.9767 


-0.3435 0.1232 


277.1449 -0.5731 153.9882 270.5582 119.8105 




803.3074 


-0.1067 -0.1577 


282.5642 -0.6199 154.4913 275.9019 120.0924 




782.5865 


0.9387 -0.2695 0.8066 


277.4852 -0.5757 154.0058 270.9052 119.7416 


ODIS 


m 


840.2650 


-0.3554 0.1633 


260.7658 -0.2741 140.0581 255.1489 113.1727 


m 


851.2619 


-0.1192 -0.1365 


266.0850 -0.3677 139.9198 260.3133 113.2412 


m 


838.5678 


0.9410 -0.2563 0.8270 


261.9485 -0.2875 140.2521 256.3134 113.0856 



data of the extracted feature locations in the image plane 
are also available (17) . 



V. Concluding Remarks 

This paper proposes a new piecewise polynomial radial 
distortion model for camera calibration. The appealing 
part of this piecewise model is that it preserves high ac- 
curacy and the property of having analytical undistortion 
formula for each segment. Experiments results are pre- 
sented to show that this new piecewise radial distortion 
model can be quite accurate and performance improve- 
ment is achieved compared with the corresponding single 
radial distortion function. Furthermore, a comparable per- 
formance with the conventional polynomial radial distor- 
tion model using 2 coefficients can also be accomplished. 



VI. Note to Practitioners 

In precision automation applications, cameras are widely 
used. However, from the results reported in this paper, 
the camera distortion calibration is usually not well done 
as demonstrated in our ODIS (Omnidirectional Inspec- 
tion System, http://www.csois.usu.edu) camera. We 
thought that the ODIS camera has a good quality but in 
fact it is not at least for the camera distortion property. 
To ensure the precision of camera calibration along with 
the property of having analytical inverse function, the dis- 
tortion model should be re-visited by using the method of 
this paper. For noncommercial use, all relevant code of this 
work is available from |17 |. 
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